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Abstract 

We study numerical integration of functions depending on an infinite number 
of variables. We provide lower error bounds for general deterministic linear algo- 
rithms and provide matching upper error bounds with the help of suitable multilevel 
algorithms and changing dimension algorithms. 

More precisely, the spaces of integrands we consider are weighted reproducing 
kernel Hilbert spaces with norms induced by an underlying anchored function space 
decomposition. Here the weights model the relative importance of different groups 
of variables. The error criterion used is the deterministic worst case error. We 
study two cost models for function evaluation which depend on the number of 
active variables of the chosen sample points, and two classes of weights, namely 
product and order-dependent (POD) weights and the newly introduced weights 
with finite active dimension. We show for these classes of weights that multilevel 
algorithms achieve the optimal rate of convergence in the first cost model while 
changing dimension algorithms achieve the optimal convergence rate in the second 
model. 

As an illustrative example, we discuss the anchored Sobolev space with smooth- 
ness parameter a and provide new optimal quasi-Monte Carlo multilevel algorithms 
and quasi-Monte Carlo changing dimension algorithms based on higher-order poly- 
nomial lattice rules. 
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1 Introduction 

The evaluation of integrals over functions with an unbounded or even infinite number of 
variables is an important task in physics, quantum chemistry or in quantitative finance, 
see, e.g., [121 US] and the references therein. In recent years a large number of researchers 
contributed to the design of new algorithms as, e.g., multilevel and changing dimension al- 
gorithms or dimension-wise quadrature methods, to approximate such integrals efficiently. 
Multilevel algorithms were introduced by Heinrich and Sindambiwe [281 129] in the context 
of integral equations and parametric integration, and by Giles [191 120] in the context of 
stochastic differential equations. Changing dimension algorithms were introduced by Kuo 
et al. [22] in the context of infinite-dimensional integration in weighted Hilbert spaces 
and dimension-wise quadrature methods were introduced by Griebel and Holtz [27] for 
multivariate integration. (Changing dimension algorithms and dimension-wise quadrature 
methods are based on a similar idea.) 

In this paper we want to study infinite-dimensional numerical integration on a weighted 
reproducing kernel Hilbert space of functions with infinitely many variables as it has been 
done in[3ll|35l[33|30lll0l|23lll3l|23l2[71|2g The Hilbert spaces we consider here 
posses so-called anchored function space decompositions. For a motivation of this specific 
function space setting and connections to problems in the theory of stochastic processes 
and mathematical finance we refer to [501 EHl SO] ■ 

We provide error bounds for the worst case error of deterministic linear algorithms; 
these bounds are expressed in terms of the cost of the algorithms. We solely take account 
of function evaluations, i.e., the cost of function sampling, and neglect other cost as, e.g., 
combinatorial cost. To evaluate the cost of sampling, we consider two cost models: the 
nested subspace sampling model (introduced in [TD], where it was called variable subspace 
sampling model) and the unrestricted subspace sampling model (introduced in [55]). 

In the nested subspace sampling model lower error bounds for infinite-dimensional 
integration were provided in [ID] for general n-point quadrature formulas in the case 
where the weighted Hilbert space of integrands is defined via an anchored kernel and the 
weights are product weights. We generalize these error bounds to general weights. In 
the unrestricted subspace sampling model lower error bounds where provided for product 
weights and anchored kernels in [53], and for general weights and the Wiener kernel in 
[23] . We generalize these results to anchored kernels and general weights. (Let us mention 
that in the randomized setting similar general lower error bounds for infinite-dimensional 
integration on weighted Hilbert spaces are provided for anchored decompositions in [22] 
and for underlying ANOVA-type decompositions in [7] ; to treat the latter decompositions, 
a technically more involved analysis is necessary.) 

In this paper we further study two classes of weights in more depths: The class of prod- 
uct and order- dependent (POD) weights, which includes, in particular, product weights 
and finite-product weights, and the class of weights of finite active dimension, which in- 
cludes, in particular, finite-diameter weights and (the more general) finite-intersection 
weights. We derive several new results for both classes of weights which might also be 
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of interest for other tractability studies of continuous numerical problems on weighted 
spaces, apart from the infinite-dimensional integration problem. 

For these two classes of weights we provide upper error bounds with the help of 
multilevel algorithms and changing dimension algorithms. These bounds show that for 
the cost functions most relevant in applications, namely those cost functions which grow 
at least linearly in the number of active variables, the convergence rate of our algorithms 
is arbitrarily close to the convergence rate of the iVth minimal integration error and our 
lower bounds are thus sharp. For the remaining cost functions, which grow sub-linearly in 
the number of active variables, our bounds are still sharp in most of the cases (depending 
on the smoothness of the kernel and the decay rate of the weights). 

These new upper bounds improve on the results obtained for product weights in [iO] 
and p3]. Furthermore, in contrast to [JOJ Thm. 3], we are able to formulate our results 
on upper bounds without introducing additional auxiliary weights that are not problem 
inherent. 

We provide explicit quasi-Monte Carlo multilevel and changing dimension algorithms 
based on higher order polynomial lattice rules for weighted Hilbert spaces of integrands 
that correspond to anchored Sobolev spaces with smoothness parameter a > 1. These 
algorithms are optimal in the sense that they achieve convergence rates arbitrarily close 
to the optimal convergence rate (i.e., the convergence rate of the A^th minimal integration 
error) . 

The article is organized as follows: In Section |2] the setting we want to study is intro- 
duced. In Section |3] we provide lower error bounds for deterministic quadrature formulas 
for solving the infinite-dimensional integration problem on weighted Hilbert spaces. In 
Section 13.11 we present the most general form of the lower bounds which is valid for arbi- 
trary weights. In Section 13.21 we state the form of the lower bounds for the two specific 
classes of weights we consider. In Section 14.11 and 14.21 we explain multilevel and changing 
dimension algorithms. In Section 14.31 we provide upper error bounds for POD weights, 
and in Section 14.41 for weights with finite active dimension. In Section [5] we illustrate the 
upper and lower bounds in the situation where the space of integrands is based on the 
univariate anchored Sobolev space with smoothness parameter a > 1. Here we consider 
specific quasi-Monte Carlo multilevel and changing dimension algorithms that achieve 
higher-order convergence. 

2 The general setting 
2.1 Notation 

For n eN we denote the set {1, . . . , n} by [n]. If m is a finite set, then its size is denoted 
by \u\. We put 

U := {u cN\\u\ < oo}. 

We use the common Landau 0-notation. For two non-negative functions / and g we write 
occasionally / = ^^{g) for g = 0{f), and / = Q{g) if / = ^{g) and / = 0{g) holds. 
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2.2 The function spaces 

As spaces of integrands of infinitely many variables, we consider reproducing kernel Hilbert 
spaces which are discussed in more detail in [301 125] • Our standard reference for general 
reproducing kernel Hilbert spaces is [S]. 

We start with univariate functions. Let D C M be a Borel measurable set of M 
and let : D X — )■ M be a measurable reproducing kernel with anchor c & D, i.e., 
K{c,c) = 0. This implies K{-,c) = 0. We assume that K is non-trivial, i.e., K 0. We 
denote the reproducing kernel Hilbert space with kernel K hj H = H{K) and its scalar 
product and norm by (■, ■)h and || • \\h, respectively. We use corresponding notation for 
other reproducing kernel Hilbert spaces. If is a constant function in H{K), then the 
reproducing property implies g = g{c) = {g,K{-,c))H = 0. 

Let p be a probability measure on D. We assume that 

M := K{x,x) p{dx) < oo. (1) 
Jd 

For arbitrary x,y E and u eU we define 

jew 

where by convention = 1. The Hilbert space with reproducing kernel will be 
denoted by Hu = H{Ku)- Its functions depend only on the coordinates j G u. If it is 
convenient for us, we identify Hu with the space of functions defined on determined 
by the kernel Hj-gu -^(^i' %)' write fu{Xu) instead of fu{x) for /„ G and x G D^, 
where Xu '■= {xj)j^u G -D". For all fu G Hu and x G we have 

fu{x) = if Xj = c for some j G u. (2) 

This property yields an anchored decomposition of functions, see, e.g., [36] . 

Let now 7 = {■ju)u&u be weights, i.e., a family of non- negative numbers. We assume 
that 7 satisfies 

^7nMH<oo. (3) 

(One may also consider slightly weaker conditions as done, e.g., in [351 Sect. 5] or [13]; for 
a comparison of these different conditions see [25].) We denote the set of active coordinate 
sets, {m G W I 7u > 0} by ^ = ^(7). (Sets m C N with 1^1 = 00 are always assumed to 
be inactive.) We always assume that A is non-trivial, i.e., that there exists a 7^ m G W 
with u E A. 

Let us define the domain X of functions of infinitely many variables by 

X:= Ix e D^^\J2^nYl K{xj, Xj) < 00 I . 
I ueA jeu ) 

Let n be the infinite-product probability measure of p on D^. Due to our assumptions 
we have fJ.{X) = 1, see [301 Lemma 1] or [2S]. For x,y E X we define 

)C-,{x,y) := '^^uKu{x,y). 
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/C-y is well-defined and, since /C-y is symmetric and positive semi-definite, it is a reproducing 
kernel on X x X, see [3]. We denote the corresponding reproducing kernel Hilbert space 
by "H-y = H{IC-y) and its norm by || • For the next lemma see [31] Cor. 5] or [25]. 

Lemma 1 The space H-y consists of all functions f = J2ueAf^' ^ ^^^^ ^^^^ 

5^ 7^1 MIL < 
In the case of convergence, we have 

\\m = j2^u'\\furH^- 

For u G ^ let denote the orthogonal projection P„ : — )• f ^ fu onto 
Then each / G H-y has a unique representation 

f = ^fu with fu = Pu{f) eHu,ue A. 



2.3 Infinite-dimensional integration 

Due to ([3]), we have Tij C d/i), and the integration functional 

/(/) := / /(x)Mda;) 
is continuous on Ti-y, i.e., the operator norm of / is finite: 

W^Wli-y = ^^uCl''^ < oo, where Co := / / K{x,y) p{dx) p{dy) < oo, (4) 



ueA 



D JD 



see, e.g., [2S]- We assume that / is non-trivial, i.e., that Cq > 0. Notice that Co < M. 
For a given set of weights 7 we denote by 7 the set of weights defined by 

7m := 7?iCQ"' for all m G W. (5) 

The representer h G Ti-f of /, i.e., the function h satisfying /(/) = (/, h)^ for all / G Tij, 
is given by 

h{x) = / IC^{x,y)fi{dy) 



JX 

and consequently the operator norm of the functional / satisfies =||^||7- For u & A 

we define lu '■= I o P„ on i.e., /«(/) = {f,Pu{h))j for all / G H-y . More concretely, 
we have 

W) = / fu{Xu)p''{dXu), 
J 

and the representer hu of /„ in "H-y is given by hu{xu) = Pu{h){xu)- Thus we have 

^(/) = 5Z^«(^«) for all /gH^. 
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2.4 Admissible algorithms, errors, and cost models 

We define the set of admissible sample points S by 

S ■.= {ixu;c)\ueU}. (6) 

Here again Xu = G D^, and {x^, c) denotes the vector y = {yi,y2, ■ ■ ■) E with 

yj = Xj if j E u and yj = c otherwise. Note that {Xu, c) G X. We consider algorithms of 
the form 

n 

Qif) = ^atf{ivi,c), for G W, (7) 

with points t^^ G (-D \ {c})'^' and coefficients G M. The worst case error is given by 

e{Q;n^):= sup |/(/)-Q(/)|. 

Il/lk<i 

For an algorithm Q of the form ([7]) we put {Q)u '■= Q ° Pu, i-e., 

n 

{Q)uif) = ^aifuit^,nu;c). 

i=l 

We have the identity 

[e{Q;n-y)]' = J2ln[e{{QUH^)]^ (8) 

where 

e((Q)„;if„)= sup - 

II9||h„<i 

For the cost of an algorithm we only take into account the cost for function evaluations. 
To make this more precise, let us fix a cost function $ : N — t- [1,oo), which is non- 
decreasing. In this paper we consider two models for the cost of function evaluations, the 
nested subspace samphng and the unrestricted subspace sampling model. 

In the nested subspace sampling model we first define for a fixed strictly increasing 
sequence w = (wi)igN of coordinate sets Wi G W2 <Z ■ ■ ■ E U the cost of a function 
evaluation in a; G X to be 

CwA^) ■= inf{$(|wi|) \ xj = c Vj ^ Wi}. (9) 

Here we use the standard convention that inf = oo. For a linear algorithm Q of the 
form ([7]) we define 

n 
i=l 

Let Cnest denote the set of all cost functions Cw^c of the form (Q where w runs through 
all strictly increasing sequences w of coordinate sets. Then we define the cost of Q in the 
nested subspace sampling model to be 

costnest(Q) := inf C^,ciQ)- 
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This model was introduced in \10\n 

In the unrestricted subspace sampling model a function evaluation f{x) costs 



Cc{x) := inflSdwl) \ u , Xj = c ^ u}. 

The cost of a linear algorithm Q of the form ([7]) in the unrestricted subspace sampling 
model is given by 

n n 

COStunr(Q) := Cc{t^^] = ^(I^^D" 

1=1 j=l 

The unrestricted subspace sampling model was introduced in [35]!^ 

We denote the cost of an algorithm Q in the nested and unrestricted subspace sampling 
model by costnest(Q) and costunrlQ), respectively. Obviously, the unrestricted subspace 
sampling model is more generous than the nested subspace sampling model. Note that in 
both sampling models the cost for function evaluations in non-admissible sample points 
is infinite. 



2.5 Strong tractability 

Let mod G {nest,unr}. The e-complexity is defined as the minimal cost among all algo- 
rithms of the form ([7j), whose worst case errors are at most e, i.e., 

compjj^Qd(e; Tij) := inf {costmod(<5) \Q is of the form ([7]) and e{Q] 7/-y) < e} . (10) 

The integration problem I is said to be strongly tractabl^ if there are non-negative con- 
stants C and p such that 

comp^^^{e; T-L-y) < C e"^ for all e > 0. (11) 

The exponent of strong tractability is given by 

^mod _ pmod^^^ _ I p gatisfies ^} . 

Essentially, l/p™"'^ is the convergence rate of the Nth minimal worst case error 

gmod^^. ^^^) _ inf{e(Q; U^) | Q is of the form © and costmod(Q) < A^}. (12) 

In particular, we have for all p > p"^"^ that e'^°'^(A^; H^) = 0{N-^/p). 

^In [To] it was actually called "variable subspace sampling model". We have chosen a different name to 
emphasize the difference between this model and the "unrestricted subspace sampling model" explained 
below. 

^In [3S] the cost model did not get a specific name. 

^We chose this notion, since it seems to us to be consistent with the usual notion of tractability in the 
multivariate setting. A more precise notion would be "strongly polynomially tractable" , to distinguish 
this kind of tractability from more general notions of tractability as introduced in , see also |41j . But 
for convenience we stay with the shorter notion "strongly tractable" . 
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2.6 Weights 

Here we introduce further definitions and notation which is necessary for our analysis of 
lower and upper bounds for the exponents of strong tractability in the different models. 

Let 7 = {'^u)u&A be a given family of weights. Weights 7 are called finite- order weights 
of order u if there exists an a; G N such that 7m = for all m G W with \u\ > u. Finite-order 
weights were introduced in [16] for spaces of functions with a finite number of variables. 
The following definition is taken from [23j . 

Definition 1 For weights 7 and a E N let us define the cut-off weights of order a 

l'^' = {li^\.u ma ^^^ = b- ^^1"'^/' (13) 

I U otherwise. 

Clearly, cut-off weights of order a are in particular finite-order weights of order a. 
We always assume that the weights 7 we consider satisfy ([3]). 

Let us denote by U\{(y\u2{p\ . . ., the distinct non-empty sets u ElA with > for 
which 7^'^|^) > ^l^J{a) — ■ ■ ■ • Let us put Uo{a) := We can make the same definitions for 
a = 00; then we have obviously 7^°°) = 7. For convenience we will usually suppress any 
reference to a in the case where a = 00. For cr G N U {00} let us define 

00 f 
tail^,^(c/) := ^ G [0, 00] and decay^_^ := sup <^ p G M lim 7^'^j^)/ = 

j=d+i ' ^ ^^"^ 

The following definition is from [23] . 

Definition 2 For a G N U {00} let t* G [0, 00] be defined as 

tl:=mi{t>0\3Ct>0yveU: \{ieN\ui{a) C v}\ < Ctl^^l*}- 

Let cr G N. Since |'Uj(cr)| < a for all i G N, we have obviously t* < a. On the other 
hand, if we have an infinite sequence {uj{cr))j^fq, it is not hard to verify that t* > 1, see 
[23]. 

In the following two subsections we describe the classes of weights we want to consider 
in this article. 

2.6.1 Product and order-dependent weights 

Product and order- dependent (POD) weights 7 were introduced in [33] and are a hybrid 
of so-called product weights and order- dependent weights. Their general form is 

lu = ^\u\Yllj, where 71 > 72 > ■ ■ ■ > 0, and Fq = Fi = 1, F2, F3, . . . > 0. (14) 
Special cases are product and finite-product weights that are defined as follows. 
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Definition 3 Let (7j)jgN be a sequence of non-negative real numbers satisfying '-/i > 72 > 
. . . . With the help of this sequence we define for u eNU {00} weights 7 = {'ju)uCfn by 



where we use the convention that the empty product isl. In the case where u = 00, we call 
such weights product weights, in the case where u is finite, we call them finite-product 
weiglits of order (at most) u. 

Product weights were introduced by Sloan and Wozniakowski in [45j and have been 
studied extensively since then. Finite-product weights were considered in [23] and are 
obviously finite-order weights of order at most u. 

It is easily seen that product weights and finite product weights of order u are POD 
weights; in f|T^ one just has to choose P,^ = 1 for all z/ G N to obtain product weights 
and P|„| = 1 for |m| < co and P|u| = for \u\ > co to obtain finite product weights. Other 
concrete examples of POD weights can be found in [331 El]- 

2.6.2 Algorithmic dimension 

The following definition introduces the concept of the algorithmic dimension of a family 
of weights. 

Definition 4 Let W C Let c/gNU{oo} be such that there exists a function 



where [00] = N. That is, (plu is injective for each u E W. If d E N, then we say that W 
has finite algorithmic dimension. In this case we call the minimal d* = d*{yV) for which 
such a (j) exists the algorithmic dimension 0/ W. 

Let 7 = (7„)„gw be a family of weights. If its set A of active coordinate sets has algo- 
rithmic dimension d*{A), we say that the family of weights 7 has algorithmic dimension 
d*{'y) := d*{A). If we do not want to specify the algorithmic dimension d* , we just say 
that 7 has finite algorithmic dimension. 

Weights 7 of finite algorithmic dimension d* are obviously finite-order weights of order 
u < d*, but finite-order weights do not necessarily have finite algorithmic dimension. 

We define a graph associated with W in the following way. For a given set W C W we 
consider the infinite simple graph Gy^ = (N, Ey^), where {i,j) with i 7^ j, belongs to the 
set of edges Ey^ if and only if there exists a -u G W with i,j E u. The graph G>v does not 
contain loops, i.e. edges (^,^). We call Gw the associated graph of W. Notice that two 
different subsets W, W of U may have the same associated graph. 

The following lemma connects the concept of minimal algorithmic dimension to the 
chromatic number x{Gw) of Gy^. Recall that the chromatic number of a graph G is the 
minimal number of colors needed to color the vertices of G in such a way that any two 
vertices connected by an edge have a different color. 

Lemma 2 Let W EU and Gy\; be the associated graph. Then the algorithmic dimension 
d*{yV) o/W and the chromatic number x{Gy\i) coincide, i.e. 




(15) 



: N — )• [(i] with the property Vm G W Vj ^ f E u : 7^ 4>{j')., 



(16) 



d*{W) = x(Gw). 
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Proof. Assume that we have given a coloring of the vertices of the graph Gw. Let the 
vertices of Gy^ be denoted by N and the colors be denoted by 1, 2, ... , x(Gw). Then we 
can define the function : N — )■ [xlGw;)] by setting = Cj, where q G [x(G^w)] denotes 
the color of the vertex i. On the other hand, if we have a function : N — )■ [(i*(W)] given, 
then we can obtain a coloring of the graph Gy^t by coloring the vertex i by By the 
definition of the function and the graph Gw this yields a coloring of the graph Gy^. 
Since both d*{yV) and x(G'>v) are minimal, the result follows. □ 

With the help of Lemma [2] we derive in the following remark a lower bound on the 
algorithmic dimension. 

Remark 1 A complete graph G with n vertices has chromatic number n, since all vertices 
are connected to each other by an edge and hence all vertices must have a different color. 
IfW has algorithmic dimension (i G N, then \u\ < d for all coordinate sets u in W, since 
G>v contains a subgraph which is a complete graph with \u\ vertices. Hence 

d*{W) > sup \u\. (17) 

Thus weights with algorithmic dimension c? G N are necessarily finite-order weights of 
order uj < d. 

The lower bound is not necessarily sharp, as shown by the following example: Let 



\u\ < 2 for all u and let there exist a sequence of sets {ii, 22}, {^2, "^3}, • • • , {*fc-i, ik}, 
{ikiii} G W where k is odd. In other words, Gyv contains an odd cycle. Then this graph 
has chromatic number 3 as can easily be shown. An even more drastic example is the set 
W := {u & U \ \u\ = 2}, which has not even finite algorithmic dimension. 

Let us now turn to upper bounds on the algorithmic dimension. 

Remark 2 As a consequence of Lemma\^ we obtain that if Gyj is a planar graph (mean- 
ing that every finite subgraph is planar), then the famous Four Color Theorem \^ says 
that Gyj can be colored with at most four colors. Hence in this situation the minimal 
algorithmic dimension of W is at most four. 

We provide further upper bounds on the algorithmic dimension in Theorem [T] and [2J 

Theorem 1 Let W C W. Then the minimal algorithmic dimension ofW is bounded by 



d*{W) < sup 



U 



u 



ueW:ieu 



Proof. By Lemma [2] it follows that it suffices to show that x(G'w) satisfies the bound. 
By [T7| Theorem 8.1.3] it follows that x(G'w) is equal to the maximum of the chromatic 
numbers x{H) over all finite subgraphs H of Gy^;. Thus it suffices to show that for all 
finite subgraphs H of Gw the chromatic number x{H) satisfies the bound. 

Let H be an arbitrary finite subgraph of Gw and let Vh denote the set of vertices of 
H. By [TTJ p. 115] we have x{H) < ^{H) + 1, where A(if) is the maximum degree of the 
vertices of H. But the degree of a vertex i in the graph Gw is equal to 

A(0 = U « - 1. 
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By taking the maximum of the degrees over all vertices in the graph Gw we obtain the 
result. □ 



In some circumstances the above result can be slightly improved using Brooks' theorem 
from graph theory, see [T7| Theorem 8.1.3]. 



Theorem 2 Let W C U such that sup^^yy \u\ > 3. Let Z = supj^j^ lUweW ieu^l- 
ii,i2, . . . be the set of vertices for which \ Uu^w-.i^eu u\ = Z. Assume that for each k > 1 
the subgraph consisting of the vertices in U„gvv:iftGw'W is not complete. Then 



d*(W) < max 

ieN 



u 



u 



- 1. 



Various other bounds on d* can be obtained from graph theory via bounds on the 
chromatic number of the associated graph, see for instance pTT] . 

Remark 3 In general it is difficult to find a function as in / fi^) for a given set W. 
This can be done by a greedy algorithm for graph coloring, see JT7| , p. 114]- However, this 
algorithm does not necessarily find a coloring with the smallest possible number of colors. 

A particular class of weights whose set W = ^ of active coordinate sets has a finite 
minimal algorithmic dimension d, is the class of finite-intersection weights defined in [23] . 

Definition 5 Let p E N. The finite-order weights {'Jujien, where •jui > 0, are called 
finite-intersection weights with intersection degree at most p eNq if we have 

|{j G NluiRMj 7^ 0}| < 1 +p for all I eN. (18) 

Note that for finite-order weights condition f lTSj) is equivalent to the following condi- 
tion: There exists an r/ G N such that 



\{i eN\k e Ui}\ < 1] for all A; G N. 



(19) 



Indeed, if ffTS]) is satisfied, then flTI?]) holds with rj < 1 + p, and if (fT^ is satisfied, then 
(US]) holds with p<{ri- l)u. 

Due to [23| Lemma 3.10] the set A of active coordinate sets of finite intersection weights 
has algorithmic dimension d*{A) at most [77(0; — 1) -|- 1]; this was shown by constructing 
inductively a mapping : N — )■ [rj{uj — 1) + 1] that satisfies ( IT6]) . It also follows from 
Theorem [T] by 



d*{A) < max 



u 



u 



ueA.iGu 



< max |{u e A \ i e u}\(uj - 1) + 1 < rjiuo - 1) + 1. 

iGN 
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3 Lower bounds 

Here we provide lower bounds for the exponents of tractability in the nested and in the 
unrestricted subspace samphng modeL We assume that there exist constants g, (3 > 
such that the nth minimal error of univariate integration on H = H{K) satisfies 

e(n; H) > g{n + 1)'^ for all n E Nq, (20) 

where 

e{n;H) ■=mi S.e{Q;H) Q{f) = J^Uifix^^) with ai e R, x^^ E d\ . (21) 

i=i J 

Since for 7^ M G W the integration problem over is at least as hard as in the 
univariate case, assumption f l20|) results in 

e(Qn;i^n)>f?Co~(n + l)-^ (22) 
for any quadrature of the form 

n 
i=l 

see [l2l Theorem 17.11]. If now Q is an algorithm of the form ([7]) and {Q)u = Q ° Pui 
then dS]) and ^ imply 

oo oo ^ 

where 6^ := Q^Cq^ and rij := \{vi \ Uj C Vi}\. Since we assumed that A is non-trivial, we 
obtain from (1231) 

^nest > punr > (24) 

3.1 Lower bounds for general weights 

In this section we study general weights; here "general" means that we only require the 
condition to hold. 

3.1.1 Nested subspace sampling 

We start with a new lower bound for the exponent of strong tractability for general weights 
in the nested subspace sampling model. 

Theorem 3 Let ${k) = Q{k^) for some s > 0, and let 7 be weights that satisfy Then 
I is only strongly tractable in the nested subspace sampling model if decay ^ > 1. In this 
case, 

p'^^^* > max <^ - , sup '-^ } . (25) 

[/3 <^eN decay^ ,^ -1 J 
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Proof. Let Q be of form ((71) with costncst(Q) < N. Then there exists an increasing 
sequence of sets w = (wi)jeN such that Cw,c{Q) < N + 1. Let m be the largest integer 
that satisfies Sdw^l) < + 1. Hence, t>i, . . . ,t>„ C Wm- Let a E N, and let 7*^°''' be the 
corresponding cut-off weights of 7. Then it is easily seen that e{Q; "H-^) > e{Q; "H^ctr)), cf. 
[221 Remark 3.3]. Thus we get from ( 12^ 

[e{Q;n,)r>b' J2 t%y 

Let now t > t*. Then, for a suitable constant Ct > 0, 

T-m := \{j\u,{a) C < Ct\wm\' = 0{N"'), 

since + 1 > Sdii^ml) = r2(|iUmn. Hence we obtain for every > max{l, decay^^^} 

00 

j=Tm + l 

This shows that / is only strongly tractable if decay^ > 1. In that case, 

^ncst y '^S/K 

~ decay^ ,, -l' 

From this and ( 12^ follows the statement of the theorem. □ 

Note that we have on the one hand t\ < t2 < t\ < ■ ■ ■ , and on the other hand 
decay^^^ > decay^ 2 — decay .^ 3 > ■ ■ ■ . Thus it is not a priori clear for which cr G N the 
supremum in ( |26|) is attained. As shown in [23] and as we will see below, this may vary 
for different classes of weights. 



3.1.2 Unrestricted subspace sampling 

The next theorem is a generalization of p3] Cor. 4.1], where only the specific kernel 
K{x,y) = mm{x,y} on D x D = [0, 1]^ was treated. 

Theorem 4 Let ${k) = Q{k'^) for some s > 0, and let 7 be weights that satisfy Then 
I is only strongly tractable in the unrestricted subspace sampling model if decay ^ > 1. In 
this case, 

f 1 2min{l,s/t;}l , , 

p'^- > max - , sup , ^ ' / . (26) 
IP aen decay^,^-! J 

Proof. The proof of Theorem H] is essentially identical with the one of Theorem 3.4 and 
Corollary 4.1 in [23]. One just has to keep in mind that the simple lower bound p* > 1 
appearing there has to be replaced by > 1//3, see (^^. □ 
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3.2 Lower bounds for special classes of weights 
3.2.1 Product and order-dependent weights 

Recall that POD weights include as special cases product weights and finite product 
weights. We now present a generalized version of [231 Lemma 3.8], which holds not only 
for product and finite product weights, but for general POD weights. 

Lemma 3 Let 7 = {'jujueu be POD weights as in P^ . Then 

decay^ 1 = decay^ ,^ for all cr G N. 

This holds still if we replace condition ^ by the weaker condition that the weights 7 are 
bounded and have only as accumulation point. 

Proof. Let a G N. Since decay^^^ > decay^^^ > 0, it remains to show that decay^ < 
decay^ ,^. We can confine ourselves to the case decay^ ^^ > 0. Let p G (0, decay^^^). This 

implies XljeN^j^^ < Thus we get 



<maxry^exp f J^ln (l + (t.Co)'/^)) < maxP^^exp ( J^il.CoY/A 



< 00, 



where we used the estimate ln(l + x) < x, which holds for all non-negative x. Since 

the sequence jujia), j € is monotonically decreasing, this implies 'jujia) = 

Hence p < decay^^.. Since we may choose p arbitrarily close to decay^^^, we obtain 

decay^ ^ < decay^ □ 

For POD weights with decay^ > 1 Lemma [3|, and Theorem [3] and H] imply strong 
tractability and 

.nest ^ / 1 2s 1 ^ f 1 2min{l, s} 



p-^*>max -,- and p"" > max - , ^ • (27) 

IP decay^i— IJ [p decay^ ^ — 1 J 

For product weights the lower bound for p'^^^^ can be derived from [iQl Thm. 4], and 
the one for p™^^ from [35] Thm. 3.3 & Sect. 5.6]. 

Notice that the lower bounds for p"*^*^* and for finite-product weights are not weaker 
than for product weights. 



3.2.2 Weights with finite algorithmic dimension 

For the special case of finite-intersection weights of order u it was observed in [23] that 
if ^(7*-'^'') = 00, then t* = 1 for all o" G N. Hence for finite-intersection weights the lower 
bounds f l25|) and f l26|) result in 

1^ 2min{l,s} ) 
(3 ' decay^^^-1 J ' 

For the Wiener kernel K{x, y) = min{x, y}, defined on [0, 1]^, the lower bound for p"" 
in (!28|) was already proved in [23^; Sect. 3.1.1]. 

For general weights of finite algorithmic dimension it is however not necessarily true 
that t* = 1 for all cr G N as the following two lemmas show. 



^nest y J - ^ I ^unr y 

13 decay^,^ - 



14 



Lemma 4 Let (i G N. Then there exists a set of weights 7 with algorithmic dimension d 
such that for all k > d there exists a v & U with l^;! = A; and 

\{u(Zv:u^ Ai-i^"^)}] > 

Proof. We construct a graph G with vertex set N and chromatic number d in the following 
way: color the vertex j G N by the color c G [d] given by c = j (mode?). Now each pair 
of vertices G is an edge of the graph G if and only if i ^ j{modd), i.e., if 

the coloring of the vertices i and j differs. Let k > d and a G [d] be given. Let G be 
the subgraph of G with vertex set v := [k]. Thus for any set m C f that consists of a 
differently colored vertices, the corresponding subgraph is complete. We now provide a 
lower bound for the number of ways a subset of v having a differently colored vertices can 
be chosen. Let r = \_k/d\. For each color c G [d], there are at least r vertices in v with 
color c. There are (^) ways of choosing a set of a different colors out of the d possible 
colors and for each color c there are at least r possible choices of vertices with this color 
c. Thus the number of possible choices is at least r°' . Hence G contains at least r°' 

cliques of size a. We now may define 7, e.g., by 7^ = Yljeu^^"^ if m is a clique in G and 
7tt = else. By construction the algorithmic dimension of 7 is d, see Lemma [2], and in 
addition ([29]) holds. □ 

Lemma 5 For each G N there exists a set of weights 7 such that ^(7) has algorithmic 
dimension d and such that for all a E N U {00} we have t* = min{cr, d}. 

Proof. For G N let 7 be weights as in Lemma HI Due to fl29l) we have for all cr G NU {00} 
that t* > min{cr, d}. Since the algorithmic dimension of 7 is d, we have additionally that 
t* < d. Since always t* < a, the statement of the lemma is valid. □ 

For general weights with finite algorithmic dimension we just know that the values 
decay^^i, . . . , decay^ satisfy the relation decay^ > • • • > decay^^^. We can, e.g., easily 
construct weights of finite algorithmic dimension whose set of active coordinate sets .4.(7) 
consists only of sets of size at least cr G {2, . . . , u}. Thus decay^ ^ = . . . = decay^ = 00, 
but decay^ ^ may be either finite or infinite. Together with Lemma [5] this argument shows 
that for general weights with finite algorithmic dimension we should use the general form 
of the bounds (125]) and (]2B]) to fully exploit the specific features of the weights we are 
working with. 



\v\ 



> 



for all CT G [d]. 



(29) 



4 Upper bounds 

Here we provide constructive upper bounds on the exponents of tractability in the nested 
and in the unrestricted subspace sampling model. To this purpose we consider two types 
of algorithms: multilevel algorithms, which perform well in the nested subspace sampling 
model, and changing dimension algorithms, which are well suited for the unrestricted 
subspace sampling model. 
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4.1 Multilevel algorithms 

Let us describe the general form of the algorithms we want to use more precisely: 
Let Lq := 0, and let Li < L2 < -L3 < . . . be natural numbers, and let 

:= ^3e[Lk\Uj and ^ — \Lk] for ken. (30) 

In the general case we will use the sets v^^\ k = 1, . . . ,m. In the special cases of POD 
weights, it is more convenient to make use of the relatively simple ordering of the corre- 
sponding set system Uj, j e N, and choose the sets for = 1, . . . , m. In all definitions 
and results that hold for both choices of the z = 1, 2, we simply write Vk, and we put 
fo := 0- We will choose the numbers Li, L2, . . . in general such that \vk\ = 0(a^) for some 
a G (1, 00). (A default choice would be a = 2.) Let 

Vfc := { j G N I Uj C Vk and Uj ^ ffc-i} for A; > 1. 

Let us furthermore define 

f/(m) := U- U {0}. 
For u eU we define the mapping : Tij — )■ Ti^ by 

{^J)ix) = f{x^;c) for all a; eD^. 

We put 

Q..(/):=E4'V(4f^;c), and 4(/) := Q..(/ - J), (31) 
j=i 

where the numbers ni > n2 > ■ ■ ■ > rim, the coefficients af^\ and the points tl^'^-*, • • • , ^[i"'"'^^ G 
[0, 1]^'' will be chosen later, depending on the weights 7. 
Define the multilevel algorithm via 

m m rik 

QTif) ■■= fic) + = /(^) + - ^..-J)(4t'^'^;c). (32) 

k=l k=l j=l 

If we choose the nested sequence of coordinate sets f 1 C f2 C fs C . . . in the nested 
subspace samphng model, then the cost of the multilevel algorithm satisfies 



costnest(QD < $(0) + 2j2nkmvk\), (33) 

k=l 

and the same cost bound is valid in the more generous unrestricted subspace sampling 
model. From ([8]) we obtain 

where (Q^)., = QT°Pu, = Er=i(Q^)«.- Note that eHQTU; H^,) = e{{Q^y, H,) = 
0, since is exact on constant functions. Notice furthermore that we have {Qk)uj{f) = 
whenever j ^ Vk, and {Qk)u,{f) = (Qvju.if) = QvMuj) if 3 ^ Vk- Thus we get 

m 

[e(Qr;^7)F = EE^'^.K(^^^K'^«.)]'+ E %■ (34) 

k=l j€Vk jiU{m) 
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Let us now for simplicity assume that Vk = [maxf^] for all A; G N, which is always 
possible by simply renumbering the variables recursively. Helpful for the construction of 
good multilevel algorithms for higher order convergence and general weights is a result of 
the following kind: 

There exists an a > 1/2 such that for each A; G N and each G N we find a quadrature 
Qvf. as in fl3T|) which satisfies in the case a = 1/2 for r = 1/2, and in the case a > 1/2 
for r G [1/2, min{a, decay^ /2}), t arbitrarily close to min{a, decay^ /2}, the bound 

lu [e {{Qvk)u ' Hu)]^ < ^£,^,7%^^ for all £ G f fc \ Vk-i, (35) 

where ^ 

C*^.-.7 = I 5Z I some Cr independent of k. (36) 

For many reproducing kernels K quadratures like this can be constructed as quasi- 
Monte Carlo quadratures. Examples are (shifted) rank-1 lattice rules or polynomial lattice 
rules constructed with the help of a component-by-component algorithm, see Section 15.41 
or, e.g., [321 Theorem 8], [131 Corollary 5.4], [23l Prop. 3.9]. 

If we use algorithms Q^^. that satisfy condition (|35|) to define Qk as in (|3T1) . then we 
obtain from (13^ 



k=l jiU{m) 

where 

Cfc,T,7 = Ce,T,-y (38) 

The aim is to minimize the right hand side of this error bound for given cost by choosing 
r, m, and ni, . . . ,nm (nearly) optimal. To this purpose one needs a good estimate for 
the constants Ck^T,^ and for the tail J2jfu{m) i-®-' ^oie specific information about the 
weights. 



4.2 Changing dimension algorithms 

For given weights 7 let ^0 be a finite subset of A{'y). A changing dimension algorithm 
is an algorithm of the form 

Q'^'^if) = E QnuAfu), (39) 
where the integrand / G Ti-y has the uniquely determined anchored decomposition 

ueA 

and Qn„,u is a quadrature rule for approximating Iu{fu)- If the building blocks Qny,,u are 
linear algorithms, then also Q*"^ is linear; this follows from the explicit formula 

/„(a;) = E(-l)l«\^l/(a..;c) 

vCu 
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for arbitrary u & A, see |36]. Thus a function evaluation fu{x) can be done at cost 
bounded by \{v E A\v ^ u]\%{\u\) < 2l"l$(|'u|). Changing dimension algorithms for 
infinite-dimensional integration were introduced in [35] . For POD weights we use a slight 
modification of the changing dimension algorithms presented in [33] and for weights with 
finite active dimension we employ the changing dimension algorithms from [351 Sect. 4]. 

4.3 Product and order-dependent weights 

We consider now product and order-dependent weights (POD) weights, where for each 
u eU we have 

In = ^\u\Yllj, 

where (T\u\)u(zu and (7j)jgN are sequences of nonnegative real numbers as in (HM . (Note 
to distinguish between 7^, where u G W is a finite set of positive integers, and 7^, 7^, where 
d,jEN are positive integers. ) 

Before we present the concrete algorithms that we use to obtain upper bounds for the 
exponents of tractability p^'^^^ and p™, we provide some useful results on POD weights. 

Lemma 6 Let p* > 2q* > 2 such that p* / (2q*) E N. For the POD weights determined by 
Ij = j'^* for j EN, To = 1 = Ti, and 

r, = ^(p-A-)smfa-./p-)^ ^ ^ 2, 

we have 

decay^ 00 = q* and decay^ = p* for all a eN. 

A rigorous proof of Lemma El can be found in Section [HI We suspect that the condition 
p*/(2q*) G N in the above lemma is not necessary. If the condition q < p* /2 can be 
replaced hj q < p* in Corollary [8] in Section |6l then the condition p* > 2q* can be 
replaced by p* > q* in the above lemma. 

Lemma considers the boundary case where for given product weights 7^-, the are 
made as large as possible such that the POD weights still have finite decay. This allows 
us to obtain cases where the decay of the POD weights differs from the decay of the 
corresponding product weights, cf. also Lemma [31 In the following theorem we consider 
POD weights where F^ is smaller such that the decay of the POD weights is always the 
same as the decay of the corresponding product weights. 

Theorem 5 Letj = {Ju)u&a be POD weights with'y^ = T\u\ Yljeulj- ^etp* := decay^ > 
1 and q < p* ■ Let there exist a constant Cg > such that F^ < Cq{k\)'^ for all k E N. In 
the case where q = p* , we additionally assume ^JLi Ij^^ < 1- Then we get the following 
results: 

If p* = q, then 

d&uC,[d] 

If p* > q, then 

E <'' = ^i^'J') forallpEiq,p*). 

d€uC[d\ 
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The last identity holds also for p = p* if Xljli Ij^^ < 

In particular, our assumptions lead for all q < p* to decay^ ^ = decay^ ^ . 

In the proof we use the multi-index notation, which we recall here: For u = {vjYj, 

id 



Ng we write \v\ := Vi + ■ ■ ■ + and u\ := 11^=1 '^r- 

Proof. Obviously, we always have 

i/p -p i/p , \ ^ i/p 

dGnC[ii] 

and decay^ o^ < decay^ j^. 

Now let us consider the case where q = p* and T := Yl^=i ^ " 

de«C[d] deu<Z[d] j€u deuCld] jeu 

Similar as in [33| Lemma 6.2] we now employ the multinomial formula and the formula 
for (finite) geometric series to obtain 



i/p* 

y ■ 



Uj/p* 



E ^m"'- e ^m"' 

K=o y^gNd.|^|=«. j=i j^gp^d-i.i^i^^ j=i 

d 



oo 



E 



Ex""' 



K=0 

1/p* 




In particular, we showed that X]mgw7" < ^) which implies that decay^^ > p*. 

Let now < Cg(A;!)^ for some q < p* , and let p G {q,p*] with Xl^i 7j^^ < (Recall 

that this sum is always finite if p < p* .) Let S := ^2 7^^^ j and set 7* := 7^/5'. 

Then Y.7=i{l*jf'^ = 1/2 < 1- Set F* = S'Tk for all k e Nq. Then there is a constant 
C* > such that F* = S^Tk < S^Cg{k\y < C*{k\y. Thus, by the argument used in the 
case = g, we get 

i/p 



E -f^"- E (^uU-'i) 

iGuQld] deuC[d] \ jeu / 



dGuC[d] deuC[d] 

In particular, we showed that X^^ew 7"^^ ^ ^'-'^ p < p*, which implies that decay^ > 
p*. The same holds for p = p* 

Corollary 1 Letj = {'~iu)um POD weights with'ju = ^\u\ Yljeu'^j- Letp* := decay^ ^ > 
1 and q < p* . Let there exist a constant Cq > such that F^ < Cq{k\y for all A; G N. 
Then we have for every t G and every constant Ct- > that 

de«C[(i] 
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Proof. Let r and be given. Obviously, X]de«c[d] 7"''''C'i"' = ^(Ty^")- Now let p G 

(max{r, Define the POD weights 7 = riMiIljGuT?' t>y 7j = IjC^. Then p* = 

decay and, due to Jensen's inequality and Theorem iSl we obtain 

E = 0((7yT/^) = 0(7^^. 

deuC[d] J 

□ 

From Corollary [T] we immediately get the following useful corollary. 

Corollary 2 Let 7 &e POD weights that satisfy the assumptions of Corollary d and let 
Vk = Vk = [Lk] for all k E N. Let t G [1/2, decay^ /2). Then we have for Ck^r^ as in 



31 

Ck,T,'y = O(cTfc), where at := E 

j=Lk-i+l 



and furthermore 



E % = E 

j^Uim) \j=L,n+l 



4.3.1 Nested subspace sampling 

Let 7 be POD weights that satisfy the assumptions of Corollary [1] Let := L\a^~^1 for 
A; G N, where L G N and a G (1, 00) are fixed. (A canonical choice would be L = 1 and 
a = 2, but in some applications other choices may be more convenient.) Furthermore, let 
Vk = vf^ = [Lk] for all k eN. Let a > 1/2. We use multilevel algorithms Q^^ as in ([32]) 
that employ quadratures Qy^ fulfilling the estimate (^5^. In particular, these multilevel 
algorithms satisfy the error estimate (l3l 



Theorem 6 Let ${k) = 0{k^) for some s > 0. Let 7 = {'~fu)u£U be POD weights that 
satisfy the assumptions of CorollaryUi We assume that there exists an a > 1/2 such that 
for all k G N and all Uk ^ N we find quadratures Q^^, as in [3l\} that satisfy (E^j- Then 
our multilevel algorithms , defined as in (3^) . establish the following result: 
In the case where s > (2a — 1)/2q; we obtain 

< max I - , 1 . (40) 



a decay^;^— 1 
In the case where < s < {2a — l)/2a, we obtain for 
decay^ ]^ > 2a: 



a 



nest ^ ^ 



2a > decay > 1/(1 — s) .■ 



p 



nest ^ 



decay ^ 
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1/(1 — s) > decay^ i > 1 

2s 



^nest ^ 



decay ^ -1 



If the assumptions of Theorem [6] hold and if additionally the nth minimal worst case 
error of univariate integration satisfies e(n; H{K)) = Q{n~°'), then, due to the lower bound 
on p"*^*^* in ( 127|) . we have a sharp upper bound on the exponent p"^^^^ if s > (2a — l)/2a, 
and for decay^ ^^ > 2a and for 1/(1 — s) > decay^ ^ > 1 if < s < (2a — l)/2a. 
Observe that the case s > (2a — l)/2a is more interesting and relevant than the case 
< s < (2a- l)/2a, see, e.g., [IHl SDl gS] . 

Notice further that Theorem [6] improves on the corresponding results in [23l HQ] for 
product weights. (Compare, e.g.. Theorem with [231 Thm. 4.2] and pUl Cor. 2], where 
the Wiener kernel K{x,y) = mm{x,y} is treated.) 

Proof. Let p G (l,decay^ ]^) and let r G [1/2, min{a,p/2}) satisfy fl35l) . (Here we treat in 
detail only the case a > 1/2; in the easier case a = 1/2 one chooses always r = 1/2.) Let 
cTfc be as in Corollary [2l Then we get from fl37j) and Corollary [2] that 

(m oo \ 

fc=l J=im+1 / 

Let m be given, and put M := J2T=i ^l- ^'^^ given cost 5* > M of order S = 6(L^) we 
choose the number of sample points Uk as := \xk], where 



2r+l 

2ts 



Xk = Car' Ll , with c = s\Y, 

\k=l 

The cost of the multilevel algorithm is then of order costnest(QTO^) — 0{S). We get 

fc=i \fc=i 
Since ak = 0{LIz\) and X]^l,„+i 7i ~ ^(-^m~^)) obtain the error estimate 

[e(gr ; = O {S-'^ (1 + Ll^^^'-) + L]^^) = O [S-'^ + S-"^) . (41) 
Case 1: s > (2a — l)/2a. Here we have two subcases. 

Subcase la: p> 1 + 2as. This implies (p — l)/s > 2a and p > 2a. Hence we obtain 

[e(Qr;^-y)f = 0(5-^0 > (42) 

and we may choose r arbitrarily close to a. 

Subcase lb: 1 + 2as > p > 1. Then it is not hard to verify that {p — l)/s G 
(0, min{2a,p}). Thus we may choose r > (p — l)/2s and get 

[e(Qr;^7)]' = 0(5-^). (43) 
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If we let p tend to decay^ we see that the estimates ( 142!) and (143|1 imply (H0|) . 
Case ^: (2a — l)/2a > s > 0. Here we have three subcases. 

Subcase 2a: p > 2a. Then {p — l)/s > 2a and we get (H2l) . where we again can choose 
r arbitrarily close to a. 

Subcase 2b: 2a > p > — s). Then (p — l)/s > p. Hence we get and may 
choose r arbitrarily close to p/2. 

Subcase 2c: 1/(1 — s) > p > 1. Then 2a > p > {p — l)/s. Choosing r > (p — l)/2s, 
we obtain f HSj) . 

Letting again p tend to decay^, we have thus verified the theorem. □ 
4.3.2 Unrestricted subspace sampling 

If the cost function satisfies $(fc) = 0(fc**) for < s < 1, we may again use multilevel 
algorithms as done in the previous subsection. In the case where we have a cost function 
${k) = fl{k^) for s > 1 and product weights, changing dimension algorithms, as considered 
in [351 113] , have proved to be the essentially optimal choice in the unrestricted subspace 
sampling setting, see the analysis in |13]. We present here a slight modification of the 
changing dimension algorithms from |13] which ensures that the results from [33] do not 
only hold for product weights but for all POD weights that satisfy the conditions of 
Corollary [TJ 

As in [13], we assume that there exist positive constants c, C, r, a non-negative Ai, 
and a A2 G [0, 1] such that for each u eU \ {0} and n eN there are algorithms Qn,u using 
n function evaluations of functions /„ G Hu with 

,j . cC» (, , ln(n + l)\"'""l-"" 



^"3-^"' ^(^rTTFl' + M^j , (44) 

where by convention the last factor in should be 1 for |n| = 1. We may assume that 
c > 1 and C > Co, so that ( H^ holds also true for n = 0. With the help of the building 
blocks Qn,u one can define changing dimension algorithms for a fixed Aq G (0, 1 — 1/ decay^) 
and any given e > in the following way: Let us put 

Lr := (45) 

for suitable r > 0. Choose r such that r < Aq ■ decay^/2. For each u E U satisfying 
7^oLi_AocCl"l < we choose Ao) to be zero and Qn^^u to be the trivial zero 

algorithm Qn„,ufu = for all G Otherwise, we put n„ = [{-f^o Li^XocC^^'^e'^y/'^^ \ 
and choose Qni,,u as in (jH]). We define the changing dimension algorithm Qf^ by 

Qf^'if) = f{c) + J2 QnUfu). (46) 

Observe that for any e > there are only finitely many u E U with > 1. For given 
£ > let 

d{e) := max G N | cC^Li^AoTJ" > • 

Then it is easily verified that \u\ > d{e) implies = 0. Thus the "e- dimension" d{e) 
is the largest number of active variables used by the changing dimension algorithm Q^^ . 
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Due to Section 14.21 we obtain 



d(e) 

costunr(g,^°) < $(0) + J] 2l^l $ ( | m| K < $(0) + $(^(5) ) ^ 2^ J] n,. 

07^nGW £=1 \u\=l 

The following theorem is a slight generalization of [lH Thm. 1]. 

Theorem 7 Lei 7 = (7u)uew be POD weights that satisfy the assumptions of Corollary 
[21 Let Ao G (0, 1 — 1/ decay^), and let r < Xq ■ decay^ /2 satisfy ( f^^P - Then the changing 
dimension algorithm Q^^ defined in satisfies 

and its cost satisfies 

COStunrlQ,''^) = O , 

where 

If the cost function $ satisfies ${d) = 0{e^'^) for some i >0, then the integration problem 
is strongly tractable with exponent 



T decay — 1 



Let us now additionally assume that ${d) = Q{d) and that thenth minimal worst case error 
of univariate integration satisfies e{n; H{K)) = // ( f^^P holds for r arbitrarily 

close to a, then 

' 1 2 



unr 

p = max 



a ' decay — 1 



In the case of product weights, the statement of Theorem [7] was proved in |13], see 
Theorem 1 and 2 there. 

In the case where we have general POD weights satisfying the assumptions of Corollary 
dl we see that decay^ ,^ = decay^ j^, see Theorem 0, and these quantities do not change 
if we multiply the 7^, j G N, by some constant. With the help of this observation one 
can verify that for the upper bound on p™'' the analysis in [13] only needs to be slightly 
modified to carry over to POD weights that satisfy the assumptions of Corollary [H The 
lower bound follows from (1271) . 



4.4 Weights with finite algorithmic dimension 

Let W C W with minimal algorithmic dimension d E N, and let {'ju)ueu be weights with 
7„ = for all M ^ W (i.e., A = A{'y) C VV). Assume furthermore, that there exist 
non-negative constants c, C, /3i, /32, an a > 0, and for any n eNq a. quadrature Qn, given 
by 

n 

Qn{f) = «!"V(*^""^) with aS") G M, G D\ (47) 
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such that 



e{{Qn)u; H^) < cCl"l {n + 1)"" (1 + ln{n + l))Mn\+p2 ^11 u C [d]. (48) 

With the help of the algorithms Qn and a mapping that satisfies ( IT6|) . we can construct 
for arbitrary v & U algorithms on "H-^ in the following way (cf. also [23, Prop. 3.11]): 
First we formally consider infinite vectors 

^{i^n) ^ jjN^ ^j^g^g ^Yie jth component is tj^"^.^ := tf^fy 
Then we define the quadrature by 

n 

QnAf) ■■= E fo^ all / G n^. (49) 

Note that for u(lv,u e W, we have |m| = |(/)(u)| and e((Q)^„)„; if„) = e((Qn)0(«); -f^.^^)- 
By combining such algorithms in a suitable way, we get the following results for nested 
and unrestricted subspace sampling. 



4.4.1 Nested subspace sampling 

In the nested and in the unrestricted subspace sampling regime we propose to use multi- 
level algorithms that employ the quadratures Q^^ = Q^^i, defined in ( 149|) . Here we 
consider for the kth. level the set of coordinates Vk = v^^^ = Uj(z[Lk]Uj and := L\a'^~'^], 
where L E N and a G (1, oo) are fixed. As in ( 13T1) . the quadrature Qk on the kth level is 
given by 

Qkif) :=C,(/ 
Due to f p^ and f HHj) we get for arbitrarily small 6 > 

m 

k=l jGVfe j^Uim) 

^ E E (^'^ + 1)'^''"^ + tai^(^n^), 

fc=l \i=Lk-i+l j 

where the constant C depends on a, 5, c, C, and /32, but not on m or the specific values 
nfc, = 1, . . . , m. Notice that in the last inequality we implicitly used ni>n2>---> rim, 
since it might happen for some L^-i < j < Lk that uj C vi for an / < A;. 

This estimate is almost identical with estimate (45) in [231 Sect. 3.2.2]: there one just 
has to replace Uk by + 1 and 5 — 1 by 5 — a, and rename the constant Cr,.uj,s by C^. 
Adapting the reasoning in [23J that follows after estimate (45), we obtain the following 
theorem. 

Theorem 8 Let %{k) = 0{k'^) for some s > 0. Let the weights 7 have finite algorithmic 
dimension, and let decay ^ > 1. Assume that there exist for a > and a//n G N algorithms 
Qn as in ( f^TP that satisfy (J^- For k = 1,2, . . ., let Q^^. = Q^^v^. '^■^ ( [7^ - Then the 
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multilevel algorithms Q^^, defined as in [3^) . establish the following result: The exponent 
of strong tractability in the nested subspace sampling model satisfies 

p-^<max(l ]. (50) 

[ a decay^ — 1 J 

If the assumptions of Theorem [8] hold and if additionally the nth minimal worst case 
error of univariate integration satisfies e{n] H{K)) = Q{n~°'), then, due to the lower bound 
on p"^*^* in fl27|) . we see that our upper bound on p'^'^^^ in (I5P1) is sharp for finite-intersection 
weights; cf. also Section I5.5.1I 



4.4.2 Unrestricted subspace sampling 

In the case where the cost function $ is of the form $(A;) = fi(A;'') for some s > 1, we can 
improve the bound on the exponent of tractability from Theorem [8] by changing from the 
nested to the more generous unrestricted subspace sampling model. For general finite- 
order weights 7 of order u appropriate changing dimension algorithms were provided 
in These algorithms can in particular be used for weights with finite algorithmic 

dimension d, which are finite-order weights of order u = d. If decay^ ^ > 1 if there 
exist algorithms Qn as in fHTl) satisfying fHHj) . then changing dimension algorithms lead 
to an upper bound 

p'^"'- <max(-,- 1, (51) 



a ' decay^ — 1 

see [351 Thm. 5(a) & Sect. 5.7]. Together with Theorem [8] this implies the following result. 

Theorem 9 Let ${k) = 0{k^) for some s > 0. Let the weights 7 have finite algorithmic 
dimension, and let decay^ > 1. Assume that there exists for some a > and all n & N 
algorithms Qn as in that satisfy assumption Then the exponent of tractability 

in the unrestricted subspace sampling model satisfies 

f 1 2 minjl, s}^ , ^ 

p"-<max -,- ^ . 52 

[a decay^ — 1 J 

Our lower bound on p"" in (l28l) shows that the upper bound (J52l) is sharp for the 
sub-class of finite-intersection weights if e(n; H{K)) = Q{n^°'). 

For finite-intersection weights and the Wiener kernel K{x,y) = min{x,y} the bound 
fl52|) was proved in [231 Thm. 3.12]. 



5 Higher Order Convergence 

In this section we confine ourselves to the domain D = [0, 1], endowed with the restricted 
Lebesgue measure. We assume that a > 1 is an integer. 



5.1 Higher order polynomial lattice rules 

Here we introduce polynomial lattice rules which can achieve arbitrary high convergence 
rates of the integration error for suitably smooth functions, see |14j . 
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Classical polynomial lattices were introduced in [37] (see also [381 Section 4.4]) by 
Niederreiter. These lattices are obtained from rational functions over finite fields. For a 
prime b let ¥f,{{x~^)) be the field of formal Laurent series over Ff,. Elements of ¥h{{x~^)) 
are formal Laurent series, 

oo 

L = ^tix-\ 

l=w 

where w is an arbitrary integer and all ti G F;,. Note that ¥b{{x~^)) contains the field of 
rational functions over as a subfield. Further let ¥b[x] be the set of all polynomials 
over Ff,. 

The following definition is a slight generalization of the definition from [3^, see also 
[55] . which first appeared in [2]; see also [151 Chapter 15.7]. 

Definition 6 Let b be prime and 1 < m < n. Let 'dn be the map from Fb((x^^)) to the 
interval [0, 1) defined by 

(oo \ n 

l=w J i=max(l,-!«) 

For a given dimension s > 1, choose an irreducible polynomial p G ¥h[x] with deg(p) = 
n>l and let q = (gi,. . . , g^) e (Fb[a;])^ ForO < h < b"^' let h = ho + hib+-- ■ + h^_ib'^-^ 
be the b-adic expansion of h. With each such h we associate the polynomial 

m— 1 

h{x) = ^ hrx'' G ¥f,[x]. 

r=0 

Then Sp^rn,n{Q) is the point set consisting of the points 

for < h < b"^ . An equal quadrature rule '^h=o fi^h) using the point set Sp^rn,n{Q) = 
{xq, Xi, . . . , Xbm_i} is called a polynomial lattice rule. 

We call q the generating vector of the polynomial lattice rule and p the modulus. For 
more information on (higher order) polynomial lattice rules see [HI [15]. 

Let X = ZT=i t e [0, 1) and let a = ZT=i t ^ [0, 1), where x^, G {0, . . . , 6 - 1}. 
We define the digital 6-adic shifted point y by 

oo 

y = x®a = Y^, 

1=1 

where yi = Xi + ai E Z^. For points x G [0, 1)'^ and cr G [0, 1)* the digital 6-adic shift 
a; © cr is defined component wise. 

Definition 7 A polynomial lattice rule Qq^p for which the underlying quadrature points 
are digitally shifted by the same cr G [0, 1)'* is called a digitally shifted polynomial lattice 
rule or simply a shifted polynomial lattice rule Qq,p{cr). 
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5.2 Reproducing kernel of smoothness a 

Let c G [0, 1] and let a > 1 be an integer. We consider the anchored reproducing kernel 
for smooth functions anchored at c given by (see [551 Example 4.2]) 

f E?;; fcf^^^ + /: d*. if y > c. 

I otherwise, 

where (x — t)+ = max(a; — t, 0) and (x — := l2:>( and for a = 1 the empty sum '^'^.Zl 
is defined as 0. The inner product of the corresponding reproducing kernel Hilbert space 
H{Ka,c) is given by 

r=l 

with corresponding norm || ■ \\HiKc,.c) = \/ (') ')h{Kc,c)- Note that for every / G H{Ka,c) we 
have /(c) =0. 

It is well known that the nth minimal error of univariate integration on H{Ka^c) is of 
order 

e(n;i/(ir,,,)) =fi(n-"). (53) 



5.3 Embedding theorem 

We now investigate the decay of the Walsh coefficients for functions in H{Ka^c)- To 
do so, we briefly introduce Walsh functions in base b P [TBI HZ]. Let 6 > 2 be an 
integer and let coh = e^'^^^^ be the 6-th root of unity. For a nonnegative integer k let 
k = kq + Kih + ■ ■ ■ + Ka-iV^^^ denote the 6-adic representation of k and for x G [0, 1) 
let X = ^ib~^ + ^2&~^ + • ■ ■ denote the 6-adic representation of x, where we assume that 
infinitely many are different from b—1. Then the fcth Walsh function in base b is given 
by 

walfc(x) = 

For a function / defined on [0, 1] we define the kth Walsh coefficient by 



/(^) = / /(a;)walfc(x)da;. 

^0 



See also |15l Chapter 14, Appendix A] for more information on Walsh functions in the 
context of numerical integration. 

Let k = Kib°-^~^ H [- n^b"'"'^ with ai > ■ ■ ■ > > and Ki, . . . , e {1, . . . ,b - 1}. 

Set 

if = 0, 

fll H h amm(a,i.) if ^ > 0. 

For a > 2 let Wq denote the space of all Walsh series / : [0, 1) — )■ M given by 



fi^) = X]/(^)waU(x), 



k=l 
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with 



km 



It was shown in [121 Lemma 3] that there is a constant Ci.r > such that 



— walfc(x) dx 



< 



if z/ > r, 

ifo<z/<r 



The constant Ci r can be chosen as 



C,,r = r! 



_2sin7r/ 

Thus, there is a constant C2 a > such that 



1 

1 + T 



1 



6 6(6+1) 



r-l 



(54) 



Q— 1 «1 



r=l 

We can choose 



X — c 



-walfc(x) dx 



' {y - cY 



a-1 



■waliiy) dy 



2,a 



r=l 



For A; G No let Jfc(x) = /q" waU(t) dt. Note that for > we have Jfe(O) = Jfe(l) = 0. 
The following result goes back to Fine [18] (see also [121 Lemma 1]). The function Jfc(x) 
can be represented by a Walsh series 

00 

Jk{x) = ^ rfc(m) walfc(x), 

m,=0 

where for G N with k = Kib°-^~^ + h K^h"""'^ and k' = k — Kib""^'^ we have 

rfc(m) = 



5-m(fc)(i/2 + (cj-'^i - l)-i) ifm = fc, 
^-MiM^^e - l)-i if m = 06<^i+«+i + k, 

otherwise. 



For /c = we have 



ro(m) 







otherwise. 



For G No and a = 1 let Xi(^) = Jq ^[t,i]ix)waAk{x) dx and for a > 1 let 



and 



xL"H^)= / (t-x)^~Valfc(x)dx. 
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Lemma 7 For a G N and t G [0, 1] we have 

\x[^\k)\ , \xi'\k)\ < Cb-"'^'^''^ for all k G Nq. 

Proof. We show the result by induction. Let a = 1. Then (x — = and 
[t — x)^. = l[o,i](x) and therefore the result follows from [121 Lemma 1]. Assume now the 
result holds for some a G N. Let k eN, k = Kib°'^~^ + ■ ■ • + K^jh'^"'^ and k' = k — Kilf^~^ 
with Ki, . . . , G {1, . . . , 6 — 1}, ai > 02 > ■ ■ ■ > > and < /c' < h""^'^ . Then 

= / (x - t)+walfc(x) dx 

= Jk{x){x - t)1 -a (x - t)""Vfc(x) dx 



—a / (x — t)"~ Jfc(x)dx 
Jo 

-a^^rfc(m) / (x — t)"^^walm(a;) dx 
m=o -^0 

oo 



m=0 

Thus there is some constant C > such that 



(k) 



a=l 



The result for xi+i can be shown by the same arguments. □ 

By keeping track of the constant in Lemma [7] one can show that the constant can be 
chosen as Ci^a given by 

We now prove the following continuous embedding. 

Theorem 10 Let a G N with a > 2. There is a constant C > such that for all 
f G H{Ka^c) we have 



Thus we have the continuous embedding 

Proof. Let / G H{Ka,c)- Then for x G [c, 1] we have the Taylor series expansion with 
integral remainder 

fix) = (/, K^A-^ x))Hi,K.^.) = £ f^'\c){x - CY + £ /(")(t) ^^~_^^+,' dt 



and for x G [0, c] we have the Taylor series expansion with integral remainder 

f{x) = (/,ir„,,(-,x))H(^„,,) = Y.f^'\c){x~cr + jj^-\t)^^^^^dt 



r=l 
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Therefore 



5^/M(c) [\x -CY W^hix)dx+ f 

Jo Jo Jo 



^^+,' waU(x) dtdx 



{a-iy. 



+ 

a-l 



1 rl 



JO 



[a — 1)1 



= E/^'Hc) [\x -cY wahix)dx+ [\[,,^{t)f^\t)xi^\k)dt 

r=l J^ J^ 

+ f\[oAt)f^''\t)xl-\k)dt. 
Jo 

Thus, using fl2\ Lemma 3] and Lemma [7] there is some constant C > such that 
|/(A:)| < Vl/^'-Hc)! [\x-cY^^^M^)dx 

r=l "^0 

Jo 

1/2 



/a-l 1 > 

< cr^'^^'^M ^|/(^)(c)r+ / \f^''\t)\^dt 

\r=l Jo J 



where the constant C > is independent of k and /. 



□ 



One can show that the constant in Theorem [TO] can be chosen as Cs^q, := -^/aCi^a, 
where Ci^^ is given by 

The result can be generahzed for tensor product spaces. Let m C N be a finite set. 
For = {Xi)i^u,yu = {yi)ieu e [0, let 



This reproducing kernel defines a reproducing kernel Hilbert space H{Ka,c,u) with inner 
product (-, ■)a,c,u and corresponding norm || ■ \\a,c,u- 
For ku = e 4"' let 

f^ai^u) = ^ ] ^-aikj)- 

We define the Walsh functions 



walfc„(a;„) = ]^walfc,(xi). 



For a > 2 we define the Walsh space Wq,,^ as the space of all Walsh series 

f{x^) = ^ /(fc„)walfc„( 
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with 

II xi, 



sup < oo. 



Using the representation f{x) = {f, Ka,c,u{-,x))H(Kc,c,u) obtains a multidimen- 
sional Taylor series with integral remainder. The kith Walsh coefficients of products of 
{xi — cY\ (xi — and {U — Xi)"^^ can all be estimated by Cb~^'^^''^\ Thus we obtain 

the following corollary. 

Corollary 3 Let u <Z N be a finite set. For a > 2 the tensor product space H{Ka,c,u) is 
continuously embedded in yVa,u- That is, there is a constant C4^a,\u\ > such that for all 
f e H{Ka,c,u) we have 

||/||>Vc,„ < C4^a,\u\\\f\\H{Ko,,^,^)- 

The constant Ci^a,\u\ can be chosen as Ci^a,\u\ = (C's,^)'"' = 
Consider now a reproducing kernel of the form 

), (55) 

uC[s] 

which defines the reproducing kernel Hilbert space H{Ka^^) with inner product (■, ■)h{Kc,~,) 
and corresponding norm || ■ \\H{Ka.~,)- Further we define the Walsh space Wa,-y, 7 = 
(7m)«c[s], as the space of all Walsh series 

fix) = /(fc)walfc(a;), 

with finite norm 

ll/llw,^ =max7-i/„||w„,„ 

mC[sJ 

where fu = {f, Ka,c,u) H{K^,y) is the projection of / onto H{Ka,c,u)- Then we have 

1/2 



^ < 



where 7 = (7«)«ch and 7„ = C4,a,\u\y/%- 



5.4 Numerical integration 

Let a > 1 be an integer. The worst-case integration error in H{Ka^c,u) using a quasi-Monte 
Carlo algorithm Qp{f) = -pj '^^eP f i^) based on the point set P = {xq, . . . ,Xn^i} C 
[0, 1]" is given by 

e{Q; H{Ka,c,u)) = sup 

Since the reproducing kernel Hilbert space H{Ka^c,u) is continuously embedded in 
Wa,u, the results on numerical integration of [6j in }Va,u apply. From [6| Theorem 3.1] we 
obtain the following result which will be used in the changing dimension algorithm. 



1 

/ f{Xu)dx^- — fiXr^ 

>^[o,i]" „=0 
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Proposition 1 Let b be a prime number, m > 1 and a > 2 be integers. Then a higher 
order polynomial lattice point set Sp^m,a{Q) with modulus p of degree am constructed 
over the finite field of order b and generating vector g G z["' can be constructed 
component-by- component such that the quasi-Monte Carlo rule Qg^p using the quadrature 
points Sp^m,am{q) satisfics 



e(g,,,; i/(i^«,e,.)) < ^C'ii/. for alll<T<a. 



(56) 



The constant here is given by 



b,a,l/T 



1 + C: 



3,Q I C*6,Q:,l/r 



Q-1 

n 



5 11 fej'A 



where C3 „ is as in Section 15.31 and 



J a - 1 

Cb,a,l/T '■= \ 

(6-6i/T)(;,i/r_i)«-i 



z/r = l, 
z/r > 1. 



Note that one does not require a random digital shift of the polynomial lattice point 
set in Proposition [1] due to the embedding of the function space H{Ka,c,u) in the Walsh 
space. This random digital shift is however required for a = 1 to get a corresponding 
result (which is not covered in Proposition [1]). 

The construction cost of the component-by-component algorithm is of 0{\u\N°'a log A^) 
operations using 0{N°') memory (where N = b"^ is the number of points), see [5]. 

Consider now a reproducing kernel of the form fl55p . For functions / G H{Ka^-y) with 
anchored decomposition / = Enc[s] /« = Enc[s] T^k^^n^^i fu{ku)^a\-k^ we have 



I fix) dx-l^Y. ^(^") <ii/iu.,. E E E b-^-^''-K^h.i^n,u) 



fc^eN;,"'\{0} 



< 



< 



E ^E^:^ E &-'^"^'"^waU„(a..,„) 
E iE^« E &-^"^'="^wal..(a..,J, 



™=0 fc„GNl"l 



where 7^ = C|^l^/^ and 7^ = I]nc^c[s] Ti- (note that ^ YlT=o^ "^^^ku{Xn,u) only takes on 
the values or 1). Let 7^ = J^vDu'^v- Using a slight generalization of [HI Theorem 3.1] 
we obtain that a higher order polynomial lattice point set Sp^rn,am{Q) with modulus p of 
degree am and generating vector g can be constructed component-by-component such 
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that the quasi-Monte Carlo rule Qg^p using the quadrature points iSp_m,am(Q) satisfies 



\ mC?;C[s] 



— ( E ^I'^'^^Ct}^^^ + 2C^M,i/.)'^' I for all 1 < r < a. 



Note that the construction above is explicit, however, the range of r is restricted to 
1 < T < a. In the following we therefore consider the range l/2<r<l. If one chooses 
1/2 < r < 1, then one can use the construction of polynomial lattice rules from [13] to 
obtain the result that there exists a digital shift cr G [0, 1)* such that 

e{Qg,M): H{Kin)) <^ f E ^'J^'^^^'J^^ I for all 1/2 < r < 1, (57) 

\uC[s] J 

for some suitable constant C'^ > independent of s and m. Note that the space H{Ka^-y) 
is continuously embedded in the space H{Ka^i,yi), where 7' = (2l"l7„)„c[s]- This follows 
from the tensor product structure of the reproducing kernel Hilbert spaces H{Ka^c,u) and 



1 
2 



|/("-^)(a;)|2ds < |/("~i)(c)|2+ / |/(")(x)|2da;, 
Jo 



which in turn follows from 

/("-i)(x) = (c)+ / /(")(i)cit, 



for X > c and an analogous expression for x < c. Thus functions in H{Ka^-y) are also in 
H(Ki^j//), where 7" = (2(°~^^l"l7u)uc[s]- Therefore f l57|) applies for functions in H{Ka^-y) 

a — 1 

where one replaces the constant C'^ with 2^^C'^. 
Note that we have 

[e(Q,,,(o-);iJ(i^,,^))]2 

= E 7.[e((Q3,»)„;if(ir,,e,.))]'+ E 7« [e ((g^,^))^ ; i/(i^„,,,J)] ' . 

In the component-by-component algorithm one updates the components gj of g induc- 
tively. The first sum over all subsets u C [s — 1] does not depend on the last component 
and is therefore fixed when updating Qg. The component-by-component algorithm then 
minimizes the second sum over all subsets s G m C [s] and this sum is then shown to 
satisfy the bound 



seuc[s] \seuc[s] j 



2t 

. {hi 
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This implies that for any 1/2 < r < a there is a polynomial lattice rule together with a 
digital shift a such that (158!) holds. For r > 1 one can choose the digital shift cr = 0. 

Such polynomial lattice rules can be constructed using a component-by-component 
algorithm as shown in for l/2<r<a = l and in [6j for 1 < r < a. 



5.5 Results for product and order-dependent weights 
5.5.1 Nested subspace sampling 

Let $(fc) = Oik'^^ for some s > 0. Let 7 = {^u)um be POD weights that satisfy the 
assumptions of Corollary [T] and have decay^^^ > 1. For A; G N and the set = v\ — [L^], 
see Section I4.H we may apply estimate fl58|) to see that our assumption fl35l) holds0 Thus 
the estimates from Theorem [6] for p"^*^^* can be established by multilevel algorithms using 
as building blocks the polynomial lattice rules explained above. Due to the fact that 
e{n; H{Ka^c)) = and our lower bound fl27|) we get, in particular, the following 

result. 



Corollary 4 Let ${k) = 9(fc'') for some s > 0. Let 7 = {'-fu)ueu be POD weights that 
satisfy the assumptions of Corollary [Jl Let a > 1 be an integer. Then our quasi-Monte 
Carlo multilevel algorithms Q^^, defined as in [3^) with polynomial lattice rules as in Sec- 



tion \5.4\ as quadrature rules Q^^, establish the following result: The infinite- dimensional 
integration problem is strongly tractable in the nested subspace sampling model. 
In the case where s > (2a — l)/2a we obtain 

p"^^* = max ( - , 1 . (59) 



a decay^i— 1 
In the case where < s < {2a — I) /2a, we obtain for 
decay^j > 2a: 



pnest 



1 

a ' 



2a > decay^ ^ > 1/(1 — s).■ 



max <; -, - — l<p"'=^t< ^ 



a' decay^ ]^ — 1 J decay^ j^' 



1/(1 - s)> decay^ i > 1.- 

^nest _ ^'^ 

decaj^i —1 

■^Recall that polynomial lattice rules consist of n points, where n is a power of a prime b. If required to 
construct a quadrature rule consisting of n points, n e N arbitrary, we generate a polynomial lattice rules 
consisting of 6™ points, b"^ < n < 6™+^, and set the quadrature weights corresponding to the "missing" 
n — 6™ points simply to zero. 
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5.5.2 Unrestricted subspace sampling 

If the cost function satisfies ${k) = 0{k'^) for < s < 1, we can use tlie quasi-Monte Carlo 
multilevel algorithms from Section 15.5.11 and achieve the same result as in Corollary HI 
If $(fc) = VL{k'^) for s > 1, we can use changing dimension algorithms as in with 
polynomial lattices rules as in Proposition [TJ Due to Corollary H] and Theorem [7] these 
QMC multilevel and changing dimension algorithms lead to the following result. 

Corollary 5 Let %{k) = Q{k^) for some s > 0. Let 7 = {'yu)u€U be POD weights that 
satisfy the assumptions of CorollaryUl Let a > 1 be an integer. 

If s > {2a — l)/2a, then the infinite- dimensional integration problem is strongly 
tractable with exponent 

Jl 2min{l,s}\ 

p =max<^-,- 

[ a decay^ ]^ —1 J 

If s < (2a — l)/2a, then the infinite- dimensional integration problem is strongly 
tractable and p™"^ satisfies the same relations as p^"^^^ in Corollary^ 



5.6 Results for weights with finite algorithmic dimension 

Let us briefly mention the results that our quasi-Monte Carlo multilevel and changing 
dimension algorithms achieve in the case of weights with finite algorithmic dimension. 

We now show how quadrature rules which satisfy (HHI) can be constructed explicitly. 
Choose t*^*'"-' in (1471) to be the first n points of a (t, a, (i)-sequence as constructed in [llj. 
The weights a\ can be chosen in the following way: Let m be an integer such that 

<n < 6'"+^ Then set aj"^ = 6"™ ioi I < i < If and for 6™ < i < n. Then ^ 
Theorem 5.4] together with Corollary E] implies that this quadrature rule satisfies f HS]) . 
In the following two theorems let Qn denote the higher order quasi-Monte Carlo rule as 
described in this paragraph. 



5.6.1 Nested subspace sampling 

Due to Theorem [8] we obtain the following corollary. 

Corollary 6 Let %{k) = 0{k^) for some s > 0. Let the weights 7 have finite algorithmic 
dimension, and let decay^ > 1. Let a > 1 be an integer. Then for all n E N the higher 
order quasi-Monte Carlo rules Qn satisfies ( f^gp . For k = 1,2, . . let Qi.j. = Q^^^v^ b& o^s 
in Then the multilevel algorithms Q^, defined as in [3^) . establish the following 

result: The exponent of strong tractability in the nested subspace sampling model satisfies 



p""""'' < max <; - 



1 2s 



a decay^ — 1 



The lower bound fl28|) on p^"^^^ shows that the upper bound in Corollary [6] is sharp for 
finite-intersection weights. 
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5.6.2 Unrestricted subspace sampling 



In the unrestricted subspace sampling setting we use for = 0{k'^) and s < 1 multilevel 
algorithms as in Corollary El and for s > 1 changing dimension algorithms, see 
Section I4.4.2[ that rely on the higher order quasi- Monte Carlo rules Qn described above. 
This results in the following corollary. 

Corollary 7 Let ${k) = 0{k^) for some s > 0. Let the weights 7 have finite algorithmic 
dimension, and let decay^ > 1. Let a > 1 be an integer. Then the exponent of strong 
tractability in the unrestricted subspace sampling model satisfies 

ri 2min{l,3} ) 

p < max <^ -, )■ . 

[a decay^ — 1 J 

The lower bound fl2Sl) on p"'^'' shows that the upper bound in Corollary [7] is sharp for 
finite-intersection weights. 



6 Appendix 

Here we provide a detailed proof of Lemma [61 

Lemma 8 Let r > 1 be a real number and define the POD weights 7^ = T^^i Yij^u^^^ 
u eU. Then there is a constant > such that 

|:7. > To + c. g (2rr/2l sinl/(2rr/2l) j " ^''^ 

If r >2, then there is a constant > such that 

rk 



ueU k=l ^ '' ^ 



TT 



2[r/2j sin7r/(2[r/2j) 



(61) 



Note that sin a; < x for x > 0, thus sin7r/r <'njr^ which implies 

7r 



1 < 



r sinyr/r 

Proof. We have 

00 00 fc 

ueU k=0 u&A jeu k=l l<ji<j2< - <jk «=1 k=l f^oo 

\u\=k times 

where C( r, • — ; "^J is the multiple Hurwitz zeta function. 
k times 

The general behavior of the multiple Hurwitz zeta function is given in ^\ Eq. (48)]. 
From p. 8] it is known that if r > 2 is an even integer, then 



(r/c + r/2)! \2sin7r/r 
k times 
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i=2 



where Rrj are some numbers with \Rr,j\ < 1 and is a positive integer satisfying 
Nj. < T'l'^ jr. From Stirhng's formula we obtain 



'2tx fc'^^e 



kr^—rk 



m^^ 

{rk)\ e {rky^e~^^ 



-rk 



where f{k) g[k) means that there are constants C,c> independent of k such that 
cgik) < f{k) < Cg{k). Thus 



{k\rar,...,r) 



k times 



(A;!)V(27r)''' 
{rk + r/2)\ \y2sin7r/r 



rk+r/2 ( Nr 

i=2 



27rr 



1 



r/2 



e v 2sin7r/r/ {rk + r/2)'''/'^ \rsin7r/r 

rk 

TT 



rk / Nr 

i=2 



Thus, for any fixed positive even integer r we have 



j:^kar^^ = j:^{k\n{. 



k=l k 

k times 



k times 



TT 



r sin vr/r 



rk 



Therefore fl60|) follows since decreasing r only increases the sum 'Yl,ueu ^'^'-^ result 
holds for all even integers r > 2 as shown above. 

Now assume that r > 2. For l/r<A<lwe have by Jensen's inequality that 



[C(^,---,r)]' 



n A 



l<jl<---<jfc 2=1 



^ E n^'r''' = C(^A,...,rA). 

l<jl<---<jfc i=l 



Choose 1/r < A < 1 such that Ar is the largest even integer smaller or equal than r. Then 

rk 



(A;!rC(r,...,r)< [(A;!)n(rA, . . . , rA)] < 



1 



TT 



/c''/2 yAr sin7r/(Ar) 



for some constant > 0. Thus 



oo -p , 

5:7.<r„ + a5:iit-'/^( 

«eW fc=i ^ '' ^ 



TT 



Ar sin 7r/(Ar) 



rk 



from which fl6Tl) follows. 



□ 



Corollary 8 Let 7 = {^u)u(dU POD weights with-^u = '^\u\ IIjguTi- Letp* 
00. Further let c, Cq > 6e constants such that 



decay., ^ < 



coj ^ <lj< cj ^ for all j > 1. 
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If for some q < p*/2 we have 

J -p'/(2q) / ^ \ /^21 

^ (fc!K/. V2bV(2g)J sin7r/(2Lr/(2g)Jy' ' ^ ' 

then decay^ Q(3 > q. 

On the other hand, if for q < p* we have 

oo fc/gpl/g / _ \ kp'/q 

(^!)2rp*/(2g)l V2rr/(2g)l sin7r/(2[r/(2g)l); ^ ^ 

t/ien decay < q. 
Proof. We have 

decay^,^ = sup < g G M : ^ 7^*^ < oo 



Thus we have for some q <p*/2 



5:o^y'<r;" + c,/,5:£^t--/,.,.( 

uew fc=i ^ ^ 

that the right hand side is finite, then decay^ > q. 
On the other hand, for q < p* we have 



^ {k\)P*/i \2[p*/{2q)\smn/{2[j)*/{2q)\ 



°° „k/q-^l/q / ^ \ P*k/q 



u&A k=l ^ ^ 



,2[pV(2g)lsin7r/(2[pV(2g)l), 
If the right hand side is infinite for some q < p*, then decay^ < q. □ 

We suspect that the condition q < p*/2 in the above corollary can be replaced by 
q < P*- 

The corollary above allows us to construct an example of POD weights where 

1 < decay^^oo < decay^^^. 

For instance, let 7j = Thus decay^ i = P* and Cq = c = 1 in the above corollary. 

Let q* he such that p*/i2q*) G N. For k G Nq let 

Then we have for q = q* that fl63p is of the same form as (1621) . which is 

oo pl/g / \ kp*/q oo 

\2[p*/{2q)\sin7^/{2[p*/{2q)\)) ^ • I J 



Due to ( 163)) we have decay^ g^ < g*. 

Let now q < q* such that []9*/2gJ = p*/2q*. For this g the left hand side of (1^ is 

oo pl/g / \ kp*/q oo 

^ (/c!)P*/9 \{p*/q*)sm{q*7T/p*) J ^ 

Thus (1^ gives us decay^ > g. 

Together with Lemma [3] this establishes Lemma El 



< oo. 
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